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Although studies on pediatric dysfunctional voiding are increasing, there have not been 
enough efforts to validate the Dysfunctional Voiding Symptom Score (DVSS) questionnaire. 
Therefore, we aimed to translate and validate the DVSS into Korean. The DVSS 
questionnaire was validated between January and October, 2013. Two bilinguals 
independently translated the English version of the DVSS questionnaire into Korean, and 
then reconciled the forward translation of the Korean version. The original DVSS was back- 
translated into English, then assessed for equivalence to the original. Cognitive debriefing 
interviews with 5 patients to test the interpretation of the translation were made, then 
modified and distributed to 48 patients for re-evaluation. A statistical analysis of inter- 
scale correlation, and test re-test consistency was performed with the Cronbach's alpha 
coefficient. The changes from patient interviews were reflected in the final version. In an 
intra-class correlation, the Cronbach's alpha was high in all of the questions (0.97, 
P< 0.001). Test re-test Cronbach's alpha analysis of reproducibility was higher than 0.8 for 
all of the 10 questions (P< 0.001). Translation and linguistic validation of Korean version 
of the DVSS questionnaire was completed by a proper process, with high reliability and 
validity. 
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INTRODUCTION 

Dysfunctional voiding (DV) is a common clinical problem seen 
in approximately 40% patients who visit the pediatric urologist 
(1). DV manifests as numerous symptoms, such as recurrent 
urinary tract infections, urinary incontinence (UI), as well as 
bowel symptoms such as constipation and encopresis. Accord- 
ing to the Standardization Committee of the International Chil- 
dren's Continence Society (ICCS), DV can be defined as "over 
activity of the urethral sphincter during the voiding contraction 
of the detrusor in neurologically normal children" However, 
such symptoms present in various ways, which makes clinical 
diagnosis and classification difficult. Although multiple meth- 
ods have been utilized in the evaluation of pediatric dysfunc- 
tional voiding (2, 3), universally applicable methodologies have 
been rare. 

In order to improve diagnostic accuracy, and to detect DV 
early, Farhat et al. (4) developed the DV scoring system (DVSS) 
questionnaire. This questionnaire was scientifically validated 
and evaluated pediatric DV. Silent DV which persists through- 
out childhood, adolescence and adulthood may be a risk factor 
for urologic diseases such as interstitial cystitis, prostatitis, or 
prostatodynia. Retrospective analysis of such patients with the 
present DVSS may be useful in promoting urological care for 
children. 



Since its development, the DVSS questionnaire has been uti- 
lized in many reports investigating DV in the pediatric popula- 
tion. Although studies on pediatric DV are increasing, there are 
not enough efforts to publish the result of its translation into 
other languages and subsequent validation. As far as we know, 
Brazilian (5), and Chinese (6) versions of DVSS have been vali- 
dated. However, as this questionnaire was written in English, 
and no similar validated questionnaires exist in Korea, a linguis- 
tic validation was necessary. When translating a questionnaire 
into another language, proper linguistic as well as cultural vali- 
dation is necessary (7). Once validated, the DVSS questionnaire 
may become an invaluable tool for analysis of DV. The aim of 
this study was to validate the DVSS questionnaire into Korean, 
and put it to clinical use in pediatric patients, with cross-cultur- 
al equivalence to the original version. 

MATERIALS AND METHODS 

Between fanuary and October 2013, the English version of the 
DVSS questionnaire was translated into Korean and validated. 
After investigation of linguistic validity, permission for transla- 
tion was obtained, then forward translation, back-translation, 
debriefing, review, final proof-reading, and testing and re-test- 
ing was performed. Afterwards statistical analysis was performed. 
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The DVSS questionnaire 

The DVSS questionnaire consists of a validated symptom scor- 
ing for wetting and functional disorders in children. The ques- 
tionnaire is comprised of 10 quantitative and qualitative uro- 
logical variables assessed by age-appropriate questions for chil- 
dren. The DVSS questionnaire is useful in objectively grading 
DV in children (4, 5) (Appendix-1). 

The validation process 

Translation and investigation of linguistic validity 
Because Farhat et al. (4), the original creators of the intellectual 
property of the DVSS questionnaire could not directly partici- 
pate as mediators in its translation, the first author controlled 
the translation. The translation research consisted of seven stag- 
es as follows between January 2013 and May 2013 (approximate- 
ly 5 months). The main methodology was similar to the transla- 
tion of Korean Version of the Pelvic Pain and Urgency/Frequen- 
cy Patient Symptom Scale, as well as the Expanded Prostate Can- 
cer Index Composite (EPIC) into a Korean version previously 
performed (7, 8). 

1) Permission for translation and acquisition of the original 
version of the DVSS questionnaire: The corresponding author 
was directly in contact with the original author of the question- 
naire, acquired written permission for the translation and the 
use of the original English version of the DVSS questionnaire by 
e-mail. 

2) Forward translation: Two translators who were born in 
Korea and had lived in an English-speaking nation for at least 
for 1 yr and fluent in both English and Korean proceeded with 
the first forward translation. They were both informed of the 
guidelines for the forward translation of the English version of 
the DVSS questionnaire and then respectively proceeded with 
translation (ver 1.0a and 1.0b). 

3) Reconciliation: The two translators reviewed the ver. 1.0a 
and 1.0b and produced a reconciled Korean version (Korean 
ver. 1.1) under the supervision of the corresponding author. 

4) Back- translation: The ver. 1 . 1 was back- translated by a third 
translator who also was fluent in the English and Korean. A com- 
parison between the original version and the back-translated 
version was performed. After this comparison, the first author 
was sent the discordant item concepts between the original and 
the back-translated versions. Those items were newly forward- 
translated, and the translation was translated again into English 
for review by the panel. The process was completed when the 
panel reviewed and accepted the new translation (Korean ver. 
1.2). 

5) Debriefing: The Korean ver. 1.2 questionnaire was present- 
ed to 5 outpatients presenting with symptoms suggestive of pe- 
diatric DV who visited the outpatient clinic of our hospital, and 
they also replied the questionnaire in order to investigate the 
appropriateness of the question items for the patients' situations 



and the linguistic understanding of each item. The patients and 
their caretakers provided feedback when they misunderstood 
the original concept of a question, when they had difficulty in 
understanding a question, and when a question was vague or 
not smooth. In each case, the authors summarized and orga- 
nized their feedback. Before participation in this study, patients 
were informed about this study and consent was obtained. 

6) The problems presented during the debriefing were re- 
viewed, and the panel of experts examined the contents. Then, 
after exchange of feedback, the Korean version 1.3 was com- 
pleted. 

7) Final proof-reading: From the Korean ver. 1.3, the final Ko- 
rean version of the DVSS questionnaire was completed after 
checking for errors in spelling or format. 

8) Testing and re-testing was performed with the complete 
questionnaire. To confirm test-retest reliability, a repeat DVSS 
questionnaire was mailed out 1-2 weeks later or the question- 
naire was re-distributed at outpatient follow-up without inform- 
ing patients of the intent to conduct the same questionnaire. As 
a result, we obtained retest data from all of the patients who an- 
swered the original questionnaire. 

Reliability analysis 

The questionnaire data was recorded in commercial statistical 
software (Excel/2003 for Microsoft Windows). Descriptive sta- 
tistics were used to describe the sample, to verify the content 
validity of the adapted instrument, and to determine the pretest 
results the following analyses were performed. The main meth- 
odology was similar to the development and validation of the 
Korean version of the Expanded Prostate Cancer Index Com- 
posite described by Chung et al. (7), and the Chinese DVSS vali- 
dation methodology (6). 

1) Cronbach's coefficient alpha was used to verify reliability. 
Cronbach's alpha values > 0.70 were established as constituting 
evidence of satisfactory internal consistency. 

2) Intraclass correlation coefficient (ICC) was used to verify 
reliability with reference to the stability of the instrument (test- 
retest). ICC values > 0.90 were considered evidence of stability. 
Statistical analyses of reliability and validity were performed 
with SPSS for Windows (version 17.0 K, SPSS, Chicago, IL, USA). 
To confirm reliability, test-retest correlation was assessed by in- 
tra-class correlation coefficient, and the internal consistency of 
each subscale was assessed by Cronbach's alpha coefficient. To 
confirm validity, the propriety of composition of the domain ca- 
tegories, interscale correlation between the function and bother 
subscales of each domain, and the inter-scale correlation among 
each subscale were analyzed. 

Ethics statement 

Prior to debriefing of the questionnaire in this study, the study 
protocol was approved by the institutional review board of Seoul 
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National University Hospital (IRB No. H- 1305-574-489). 
RESULTS 

Forward translation and reconciliation 

In the forward translation process, consensus of the basic ter- 
minology was reached. The "Dysfunctional Voiding Symptom 
Score" was translated in this study without disagreement in Ko- 
rean by both translators. "Half the time" was translated into 
"half" by Translator B and "50%" by Translator A, which has the 
same meaning, but Translator B chose to write it in numbers. 
As for Question 4, Translator A translated it as "I have to push 
hard when I have a bowel movement" and Translator B chose 
to express it as "I have to push a lot when I have a bowel move- 
ment" in Korean. Question 6 was translated as "When I hold 
urine, I cross my legs, squat, or move my legs as if I am danc- 
ing." by Translator A, and "When I hold urine, I cross my legs, 
squat, or dance as if I am holding urine." in Korean by Transla- 
tor B. 

Backward translation 

Translator C translated "Dysfunctional voiding symptom score" 
as "Voiding dysfunction symptom score" which the panel con- 
sidered acceptable. During the back translation, question 6 was 
quite awkward, "When I hold my urine in, I have to do so by 
crossing my legs, squatting, or tapping my feet lighdy on the 
floor" which was due to a misunderstanding by the translator. 
The panel decided to use the original reconciled forward Kore- 
an translation without further correction. The back translation 
done by Translator C was a little bit formal compared with the 
original DVSS questionnaire, which was because she had older 
subjects in mind. The original DVSS is written in easy English, 
targeting younger subjects, which caused this difference. How- 
ever, the panel decided that such subtle differences in nuances 
did not affect the overall meaning, and used the original recon- 
ciled forward Korean translation. 

Results of the debriefing 

After completion of the final backward translation of the DVSS 
questionnaire, 5 patients provided feedback for the question- 
naire provided during the debriefing process. The questions 
that were considered unclear and were requested to be modi- 
fied were identified during debriefing. As for question 3, the pa- 
tients were asked whether they missed having a bowel move- 
ment every day. The original question itself is confusing, in that 
the patient does not know whether to answer whether they do 
not defecate on an everyday basis, or whether they fail to defe- 
cate daily occasionally. The options to choose from are also con- 
fusing. The option 'almost never' means that the patient rarely 
misses having a daily bowel movement, which could be easily 
phrased into T usually have a daily bowel movement; Likewise, 
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the answer 'almost every time' is also confusing. When the pa- 
tient answers that he or she misses having a bowel movement 
almost every time, a more simple expression would be that T 
rarely have a bowel movement every day (daily).' The option 'not 
available' was also pointed out as confusing, because patients 
considered T do not precisely remember' as more easy to un- 
derstand. However, in an effort to keep the validated question- 
naire as similar to the original as possible, question 3 was chang- 
ed to mean " I do not have a bowel movement every day" and 
was changed into the Korean accordingly; "I do not have a bow- 
el movement more than once every day." Question number 5 
was also confusing, in that it asked patients whether they went 
to the bathroom one or two times each day, answering 'almost 
never' might mean that they might miss voiding during the day- 
time completely, or void more times than three during the day. 
As for patients with enuresis or daytime frequency, most pati- 
ents answered 'almost never' to question number 5. However, 
daytime voiding frequencies of more than 7 times or 10 times 
could not be quantitatively analyzed. Therefore, in order to min- 
imize confusion, we modified the question to "I go to the bath- 
room less than two times during the day" in order to clarify the 
meaning of the question, and changed the Korean question ac- 
cordingly; "I go to the bathroom to void less than twice day" The 
patients commented that they could understand other ques- 
tions without too much difficulty. However, as for question 10, 
they often asked whether they had to ask 3 points each for each 
option that they answered yes. We informed them that regard- 
less how may options the patient might answer yes to question 
10, they would be counted as 3 points, without any additional 
points. The final corrected version was completed. After com- 
pletion, 5 patients debriefed the questionnaire, and responded 
that no questions were confusing. 

Statistical validation 

After review of such feedback about the final correction version 
of the questionnaire, two reviewers decided to distribute this 
debriefed version and test and re-test its validity. This final ques- 
tionnaire was distributed to 48 patients. The demographics of 
these 48 patients were as following. The mean age of the patients 
was 8.0 yr ( ± 3.37, SD) Twenty-four patients were male, and 24 
were female. The chief complaints were evaluated (Table 1). 
Among the 48 patients analyzed, 29 (60.4%) showed DV symp- 
toms, and 19 (39.6%) perceived themselves as asymptomatic. 
In an intra-class correlation, the Cronbach's alpha was high in a 
comparison of all of the questions (0.97, P < 0.001). Test re-test 
analysis of reproducibility showed that the Pearson's coefficients 
and Cronbach's alpha were higher than 0.7 for all of the 10 ques- 
tions of the DVSS questionnaire, and such a correlation was 
statistically significant (P < 0.001) (Table 2). Such high internal 
consistency reflected the reliability of the Korean version of DV- 
SS. In addition, a multivariate logistic regression analysis of fac- 
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Table 1 . Patient demographics 



Parameters (unit) 


Mean + SD 




Age(yr) 8.0 (+3.3) 


Gender (No. of children) 






Boys 


24 (50%) 




Girls 


24 (50%) 




Voiding symptoms 






None 


19(39.6%) 




Enuresis 


15(31.3%) 




OAB 


12(25.0%) 




Others 


2 (4.2%) 




OAB, Overactive bladder. 






Table 2. Test re-test correlation analysis and Cronbach's alpha 




Variables Pearson's coefficient 


Cronbach's alpha 


P values 


Question 1 0.899 


0.967 


0.001 


Question 2 0.746 


0.967 


0.001 


Question 3 0.837 


0.854 


0.001 


Question 4 0.878 


0.919 


0.001 


Question 5 0.770 


0.949 


0.001 


Question 6 0.908 


0.893 


0.001 


Question 7 0.854 


0.951 


0.001 


Question 8 0.927 


0.913 


0.001 


Question 9 0.919 


0.988 


0.001 


Question 10 0.867 


0.929 


0.001 



The questions are those of the final Korean version of the dysfunctional voiding symp- 
tom score (DVSS) questionnaire. 



tors affecting DV showed that question number 7 "When I have 
to pee, I cannot wait" showed statistically significant correlation 
with self-reported DV symptoms (Table 3). 

DISCUSSION 

During the validation of the DVSS questionnaire, we experienc- 
ed several obstacles not described in literature. First of all, the 
double negative expressions in English were often awkward 
when translated into Korean. Simplifying the original sentence 
was often required in order to make a smooth translation, and 
after debriefing, such modifications improved the understand- 
ing of the responder. Some of the options for the answers were 
rather ambiguous, especially 'not available! We modified the 
expression to mean 'I do not recall' in Korean. After we modi- 
fied the expression, the responders showed improved under- 
standing of the questionnaire. 

According to the statistical analysis of our study, the Korean 
version of the DVSS had a reliable test-retest consistency, show- 
ing reliability of the questionnaire translation. However, that 
questions such as number 5 only asked the total number of void- 
ing per day, without specification of daytime or nighttime, and 
that there was no weight in multiple stressors in question 10 
might have benefited from additional questions. However, be- 
cause this study was about validation of a previous question- 
naire and not development of a new one, such items could not 



Table 3. Multivariate logistic regression analysis of factors affecting dysfunctional 
voiding 



Parameters 


B 


S.E 


Pvalue 


Exp (B) 


Age 


U.ol 


u.uyy 


n /inn 

u.4uy 


-1 not; 

1 .UoO 


Gender 


n Ken 


U.OU4 


n OAR 


n rrr 


uvbb uuestion i 


-U.l 


U.ooo 


U. / Zo 


U.o/4 


uvoo uuesuon z 


U.£0 I 


U.oUo 


n o^R 


I .oZD 


DVSS Question 3 


0.528 


0.395 


0.181 


1.696 


DVSS Question 4 


0.291 


0.452 


0.519 


1.338 


DVSS Question 5 


0.637 


0.481 


0.185 


1.891 


DVSS Question 6 


0.028 


0.337 


0.934 


1.028 


DVSS Question 7* 


1.480 


0.587 


0.012* 


4.392 


DVSS Question 8 


-0.288 


0.550 


0.676 


0.750 


DVSS Question 9 


-0.244 


0.586 


0.138 


0.783 


DVSS Question 10 


-0.479 


0.323 


0.138 


0.620 


DVSS total score 


-0.135 


0.751 


0.857 


0.873 



The questions are those of the final Korean version of the DVSS questionnaire. *P < 0.05. 



be added. That question number 7, which evaluated urgency, 
showed correlation with self-reporting of symptoms was inter- 
esting. In the Chinese validation process, when the questions 
were classified into domains of 'overactive bladder symptoms,' 
'difficult elimination symptoms,' and 'stress and dysuria symp- 
toms,' all of the domains showed statistical significance with 
presence of DV (5). Why such discrepancy was observed is not 
definite, but might be caused by the small number of patients, 
and a selection bias at the outpatient department. In future stud- 
ies, randomized case controlled validation might be beneficial. 

During this study, the authors translated the English DVSS 
questionnaire into Korean and investigated its linguistic validi- 
ty. This study has an advantage that is the first prospective vali- 
dation of the DVSS questionnaire in Korea. The Korean version 
of the DVSS questionnaire can be used as a screening test for 
diagnosing pediatric DV patients in the future. However, due to 
limited follow-up in some cases, and improvement of symp- 
toms during follow-up which affected questionnaire results, an 
accurate test-pretest analysis was not possible. In future studies, 
a short-term follow-up and re-test would provide more valu- 
able information. In addition, it shows promise for clinical ap- 
plication in the future. The Korean version of DVSS was devel- 
oped to reflect the original version, and was adapted to the Ko- 
rean culture and language. Reliability and validity were accept- 
able. 

In conclusion, the cross-cultural adaptation process of the 
DVSS questionnaire to be used on Korean children was success- 
fully completed following internationally accepted methodolo- 
gies. The Korean version of DVSS is acceptable as an accurate 
diagnostic tool with cross-cultural variety in international mul- 
ticenter research. 
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Appendix 1 . The original dysfunctional voiding symptom score (DVSS) questionnaire 



Over the Last Month 



Almost Less than 
Never Half the 
Time 



About 
Half the 
Time 



Almost 
Every 
Time 



Not 
Available 



1 - 1 have had wei clothes or wet underwear during the 0 I 
day. 

2 - When I wet myself, underwear is soaked. 0 1 

3 - 1 miss having a bowel movement every day. 0 1 

4 - I have to push for my bowel movements to come 0 1 
out. 

5 - I only go to the bathroom one or two times each 0 I 
day. 

6 - 1 can hold onto my pee by crossing my legs, squatting 0 1 
or doing the "pee dance". 

7 - When 1 have to pee. I cannot wait. 0 I 

8 - 1 have to push to pee. 0 1 

9 - When 1 pee it hurts. 0 I 

10 - Parents to answer. Has your child experienced some- NO (0) 
thing stressful like to example below? 

New baby. 
New home. 
New school. 
School problems. 
Abuse (sexual/physical). 
Home problems I divorce ■■'death). 
Special events (birthday). 
Accident'injury. 
Others. 



NA 

NA 
NA 
NA 

NA 

NA 



NA 
NA 



YES (3) 



Total 
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Appendix 2. The Korean version of the dysfunctional voiding symptom score (DVSS) score 
a+ *¥ai: 

IHWW 9« fi^) SKi °W •» Hi 

1. Mt*( iW 0 1 2 3 4— 

2. 4fe i#i ^3, #«! 0 12 3 4 

3. Lfe HPSi a H°J »1 tt^ 4? 1«. 0 12 3 4 

4. l+fc qifli * nfl qX)£ fl°ra SW. 0 1 2 3 4 

5. 4fe SpgU<i|*| IK JLfc *M 0 12 3 4 

6. I+fe i«i Si A TO 0 12 3 4 

7. l+fe <W Si PIB 0 12 3 4 

s. i«i * "A ui m «tfe 2^ o i 2 3 4 

9. 4* itfi » nil 0 12 3 4 

10. j^wi w^ia. 

mn °?aii2i *s^i*7> <ra * 
at ai =as«ra**w? s>) sm pj 

- **i 'sm 

- m 

- m 

- m<ms\ m 

- ^a«wa pa® 

- m 
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